Argumentation-Relevant Metaphors in Test-Taker Essays
نویسندگان
چکیده
This article discusses metaphor annotation in a corpus of argumentative essays written by test-takers during a standardized examination for graduate school admission. The quality of argumentation being the focus of the project, we developed a metaphor annotation protocol that targets metaphors that are relevant for the writer’s arguments. The reliability of the protocol is κ=0.58, on a set of 116 essays (the total of about 30K content-word tokens). We found a moderate-to-strong correlation (r=0.51-0.57) between the percentage of metaphorically used words in an essay and the writing quality score. We also describe encouraging findings regarding the potential of metaphor identification to contribute to automated scoring of essays.
منابع مشابه
The Relationship between Iranian EFL Learners’ Linguistic and Logical Intelligences and the Frequency of Fallacies and Evidence in their Argumentative Writing: A Gender-based Study
The learners’ ability to write a well-organized argumentative essay has gained prominence within the last decades. The multiple intelligences play a significant role in enhancing the precision of both language and thought during the writing process. The current study aimed at investigating the possible relationship between linguistic and logical intelligences and the frequency of informal falla...
متن کاملMeasuring the Use of Factual Information in Test-Taker Essays
We describe a study aimed at measuring the use of factual information in test-taker essays and assessing its effectiveness for predicting essay scores. We found medium correlations with the proposed measures, that remained significant after the effect of essay length was factored out. The correlations did not differ substantionally between a simple, relatively robust measure vs a more sophistic...
متن کاملLexical Chaining for Measuring Discourse Coherence Quality in Test-taker Essays
This paper presents an investigation of lexical chaining (Morris and Hirst, 1991) for measuring discourse coherence quality in test-taker essays. We hypothesize that attributes of lexical chains, as well as interactions between lexical chains and explicit discourse elements, can be harnessed for representing coherence. Our experiments reveal that performance achieved by our new lexical chain fe...
متن کاملScoring Persuasive Essays Using Opinions and their Targets
In this work, we investigate whether the analysis of opinion expressions can help in scoring persuasive essays. For this, we develop systems that predict holistic essay scores based on features extracted from opinion expressions, topical elements, and their combinations. Experiments on test taker essays show that essay scores produced using opinion features are indeed correlated with human scor...
متن کاملThe Advice Taker 2.0
Starting from McCarthy’s seminal proposal for the construction of an advice-taking machine, we show how tools from abstract argumentation and computational learning can help disambiguate and formalize that goal. Our focus is on establishing provable guarantees on the realizability of the advice taker, and on implementing an actual prototype system.
متن کامل